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ABSTRACT: The purpose of this study was to identify the most important perceived enablers and 
barriers regarding sustainability of school-wide positive behavioral interventions and supports. 
School personnel representing 860 schools implementing or preparing to implement school-wide 
positive behavioral interventions and supports completed an open-ended survey of factors regarding 
its sustainability. Qualitative analyses were used to assess perceptions of the most important factors 
related to sustainability. Thematic analysis produced 13 themes regarding enablers and/or barriers. 
The most commonly cited enablers were staff buy-in, school administrator support, and consistency. 
The most commonly cited barriers were staff buy-in, resources: time, and resources: money. Results 
are discussed in terms of enhancing durability of evidence-based practices in schools. 


■ Despite the knowledge base identifying 
evidence-based practices and policies to sup¬ 
port their use, their adoption remains low and 
implementation in schools is often inconsistent 
(Burns & Ysseldyke, 2009; Cook & Schirmer, 
2006; Cook, Tankersley, & Landrum, 2009; 
Fixsen, Blase, Metz, & Van Dyke, 2013). Given 
the importance of implementing evidence- 
based practices to improve student outcomes, 
particularly for students with disabilities or who 
are at increased risk for poor academic and 
social outcomes, this lack of uptake is of 
particular concern and continues to merit 
attention from both practitioners and research¬ 
ers. In particular, students identified with 
emotional/behavioral disorders (EBD) often 
have extensive challenges that can impede 
academic and social success in school and 
beyond (Wagner, Kutash, Duchnowski, Ep¬ 
stein, & Sumi, 2005). These poor outcomes 
for students with EBD draw further attention to 
the need for effective and sustained implemen¬ 
tation of evidence-based practices in schools. 
The study of practice adoption, implementa¬ 
tion, and sustainability is known as implemen¬ 
tation science (Forman et al., 2013), and it has 
been identified by prominent educational 
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researchers as the most important research 
challenge for the next 25 years (McIntosh, 
Martinez, Ty, & McClain, 2013). This approach 
is especially critical for the study of sustain¬ 
ability of school-based interventions because 
there are many instances of successful initial 
implementation that have failed to sustain 
(Santangelo, 2009; Sindelar, Shearer, Yendol- 
Hoppey, & Liebert, 2006). 

There is a small but growing literature base 
identifying factors that aid in the sustained 
implementation of evidence-based practices 
(i.e., enablers) and factors that impede their 
sustainability (i.e., barriers). The identification 
of enablers of and barriers to sustainability can 
assist school practitioners and administrators 
in identifying strategies to use or avoid when 
planning for implementation and sustainabili¬ 
ty. Common enablers and barriers that have 
been identified in the literature are outlined in 
the following sections. 

Enablers of Adoption, Implementation, 
and Sustainability of School Practices 

School administrator support. It has been 
widely found that school administrators (e.g., 
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building principals) play an important role in 
the successful implementation of evidence- 
based practices in schools (Forman, Olin, 
Hoagwood, Crowe, & Saka, 2009; Kincaid, 
Childs, Blase, & Wallace, 2007; Langley, 
Nadeem, Kataoka, Stein, & Jaycox, 2010; 
McIntosh et al., 2014). Administrators who 
were most effective in supporting implementa¬ 
tion (a) were actively involved in the school's 
operations and adoption of practices, (b) 
showed a prominent leadership style, and (c) 
acted as facilitators in the process (Forman et 
al., 2009). The importance of school adminis¬ 
trators in implementing practices is fairly 
consistent across studies because the principal 
is highly instrumental in recruiting and main¬ 
taining broad support for practices (McIntosh 
et al., 2014). Research indicates that both 
effective managerial skills and regular voicing 
of active support for the intervention are crucial 
to intervention success (Forman et al., 2009). 

Staff support. In addition to administrator 
support, grassroots teacher support (Forman et 
al., 2009; Langley et al., 2010), or staff buy-in 
(Sanford DeRousie & Bierman, 2012), has 
been identified as an enabler to the adoption 
and implementation of evidence-based prac¬ 
tices. Staff buy-in refers to a commitment to the 
principles behind the philosophy of the in¬ 
tervention, such as explicit instruction, in¬ 
clusion, or the use of positive school discipline 
practices. The proportion of teachers who 
were open both to learning about the practice 
and to volunteering to train other staff mem¬ 
bers is associated with successful implementa¬ 
tion (Forman et al., 2009). In addition, teachers 
who perceived that students benefited from an 
intervention were more likely to support the 
implementation and sustainability of that in¬ 
tervention (Andreou, McIntosh, Ross, & Kahn, 
in press; Baker, Gersten, Dimino, & Griffiths, 
2004; Sanford DeRousie & Bierman, 2012). 

Training and professional development. 
Training affects implementation of evidence- 
based practices in school settings in several 
ways, depending upon the quality of training 
provided, the length of time since training 
occurred, and the continued professional de¬ 
velopment and technical assistance provided 
to staff implementing the intervention. Earlier 
studies have identified training and ongoing 
professional development as a factor for 
sustainability (Bradshaw & Pas, 2011; McIn¬ 
tosh, Mercer, et al., 2013). General preservice 
training of staff also appears to make a differ¬ 
ence. Bradshaw and Pas (2011) noted that the 
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percentage of certified teachers in a school 
was an enabler for practice implementation. 

Consistent approach. Consistency refers to 
use of a common language and common goals 
in the school among staff members. Aligning 
school goals and philosophies with the new 
intervention is a critical predictor of imple¬ 
mentation (Forman et al., 2009; Payne & 
Eckert, 2010). This activity allows critical 
members of the support team to identify the 
fit of a program in the context in which it will 
be implemented. Similarly, in an effort to 
scale-up school interventions, Bradshaw and 
Pas (2011) identified that sharing a common 
goal was critical for initial implementation. 

Teaming. Teaming refers to the consisten¬ 
cy with which meetings occur, knowledge of 
the team, and meeting organization. Coffey 
and Horner (2012) and McIntosh, Mercer, et 
al. (2013) found that efficient teaming, in¬ 
cluding regular meetings and meeting efficien¬ 
cy, were among the strongest predictors of 
sustainability. Previous research suggested that 
contextual factors such as disorganization can 
greatly impede adoption of positive behavioral 
interventions and support (PBIS; Bradshaw & 
Pas, 2011). Therefore, maintaining regular, 
focused meetings throughout the course of 
implementation is important. 

Barriers to Implementation and 
Sustainability 

The existing literature has also documen¬ 
ted a number of major barriers to the effective 
implementation of evidence-based practices in 
schools. In many cases, the barriers identified 
are the same themes as enablers (i.e., the lack 
of an enabler), although some notable differ¬ 
ences are present. 

Lack of resources. Resources refer to time, 
money, and staffing and can be in relation to 
a lack of financial resources or staff time 
to support an intervention. Several previous 
studies identified a lack of resources (particu¬ 
larly removal of resources after implementa¬ 
tion) as one of the most detrimental barriers to 
sustainability of an intervention (Forman etal., 
2009; Kincaid et al., 2007; Massatti, Sweeney, 
Panzano, & Roth, 2008; McIntosh et al., 2014; 
Sanford DeRousie & Bierman, 2012; Seffrin, 
Panzano, & Roth, 2009; Tyre, Feuerborn, & 
Lilly, 2010). 

Lack of parent engagement. Parent en¬ 
gagement is regarded as critical in many 
school-based interventions, but the degree to 
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which authentic engagement is obtained varies 
considerably. According to Langley et al. 
(2010), school personnel report challenges in 
obtaining the support of parents due to 
difficulty in making initial contact and engag¬ 
ing parents in the intervention. Furthermore, 
McIntosh et al. (2014) found that family 
involvement was perceived as less important 
to initial implementation but critical to sus¬ 
tainability. 

Logistical barriers. Logistical barriers have 
been referenced as impeding implementation 
in several different forms, including time, 
school climate, and data systems. Tyre et al. 
(2010) noted the inability to track data reliably 
as a large barrier to implementation. Although 
school staff were committed to successful 
implementation, there were no adequate data 
tracking systems in place (i.e., a system to 
reliably track office discipline referrals). The 
nature of school systems themselves was also 
considered a logistical barrier (Langley et al., 
2010), given that school personnel have re¬ 
ported challenges in making even basic sched¬ 
ule changes to accommodate implementation. 

Competing priorities. Schools are con¬ 
fronted with multiple priorities and tasks, 
and implementation of a new intervention 
sometimes competes with already-existing 
requirements in the school setting (Adelman & 
Taylor, 2003). School personnel are often most 
concerned with statewide testing requirements 
due to academic expectations from school, 
district, and state administrators (Forman et al., 
2009), or they are already confronted with 
multiple duties that do not include the imple¬ 
mentation of a new intervention (Langley et al., 
2010; Sanford DeRousie & Bierman, 2012). 
Current initiatives compete with the demands 
that a new intervention would necessitate. 

Lack of administrator or staff support. 
Similar to research on the enablers of imple¬ 
mentation, lack of administrator and teacher 
support was identified as problematic for 
implementation (Kincaid et al., 2007). A lack 
of teacher buy-in has been noted as a signifi¬ 
cant barrier because teachers who are not 
supportive of the intervention are unlikely to 
see the benefits of the intervention or practice 
(Langley et al., 2010), either due to attributing 
improved student outcomes to unrelated fac¬ 
tors or to lacking implementation that would 
allow improved student outcomes (Han & 
Weiss, 2005). This barrier is compounded by 
the general difficulty of recruiting staff to assist 
with initiatives (Seffrin et al., 2009). In 
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addition, Forman et al. (2009) found that 
implementation was significantly diminished 
even when administrators displayed "passive 
resistance" to the practice. Passive resistance 
includes stating that one supports the inter¬ 
vention but not learning about the intervention 
or implementing its core features. 

Enablers and Barriers Regarding School- 
Wide Positive Behavioral Interventions 
and Supports 

Klingner, Boardman, and McMaster (2013) 
highlighted the importance of researching 
practices that have successfully been taken to 
scale (i.e., adopted and implemented widely). 
One example of such a practice is school-wide 
positive behavioral interventions and supports 
(SWPBIS) due to its large-scale implementation 
across the nation (in more than 20,000 schools 
in the United States; Horner, 2014). SWPBIS is 
a systems-level preventive approach to man¬ 
aging school-wide behavior problems (Sugai & 
Horner, 2009). It is based on a preventive 
framework that includes the application of 
behaviorally based principles to address prob¬ 
lem behavior in schools. The approach focuses 
on creating and sustaining primary, secondary, 
and tertiary systems of support in a framework 
for implementation that supports the adoption 
and implementation of evidence-based prac¬ 
tices. A growing body of research supports the 
effectiveness of SWPBIS (Horner, Sugai, & 
Anderson, 2010). It has been shown in 
randomized controlled trials to be effective in 
reducing student office discipline referrals, 
suspensions, and bullying as well as improving 
academic achievement, emotional regulation, 
and school safety (Bradshaw, Mitchell, & Leaf, 
2010; Bradshaw, Waasdorp, & Leaf, 2012; 
Horner et al., 2009; Waasdorp, Bradshaw, & 
Leaf, 2012). 

McIntosh etal. (2014) assessed school and 
district personnel's perceived importance of 
various contextual variables regarding the 
implementation and sustainability of SWPBIS 
using the School-Wide Universal Behavior 
Sustainability Index: Schools Teams (SUBSIST; 
McIntosh, Doolittle, Vincent, Horner, & Ervin, 
2009). Qualitative analyses were used to 
assess perceptions of the most and least 
important variables for both initial implemen¬ 
tation and sustainability of SWPBIS. Themes 
generated from open-ended questions re¬ 
vealed that administrator support, staff buy- 
in, fidelity of implementation, and use of data 
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were considered to be the most important 
variables enabling sustainability. In addition, 
lack of resources were considered to be the 
most significant barrier to sustaining SWPBIS. 

One limitation of this study is the sample 
of schools. Schools in this study had been 
implementing SWPBIS for an average of 5 
years (with 9% implementing for 0 to 1 years, 
36% implementing for 2 to 4 years, and 55% 
implementing for 5 or more years), and fidelity 
data from this sample indicated that most of 
the schools were effectively sustaining SWPBIS 
at the time of the survey (McIntosh, Mercer, et 
al., 2013). Research indicates that schools that 
have been implementing SWPBIS for this 
length of time are extremely likely to sustain 
implementation because schools are at great¬ 
est risk of abandoning SWPBIS within the first 
2 years of implementation (Nese et al., 2015). 
Thus, although the perspectives of school team 
members and administrators from these 
schools are important, including a broader 
range of schools in the sample, especially 
more schools at the initial stages of imple¬ 
mentation, could indicate a more generaliz- 
able set of perceived enablers of and barriers 
to the sustainability of SWPBIS, which would 
be most helpful for practitioners and policy 
makers. In addition, examining perceived 
enablers and barriers at the outset of imple¬ 
mentation (during the initial planning period) 
may shed light on enhancing support in the 
"fragile period" in which effort is expended 
but without the reinforcement of improved 
student outcomes (Andreou et al., in press). 

Purpose 

Although the literature has yielded valu¬ 
able information regarding contextual vari¬ 
ables that function as enablers of and barriers 
to the effective implementation of evidence- 
based practices in schools (such as SWPBIS), 
additional research examining features that 
contribute specifically to sustainability is 
warranted. By first identifying what school 
personnel perceive as enablers of and barriers 
to the sustainability of SWPBIS, future research 
can then experimentally evaluate the effects of 
interventions to alter these variables. This line 
of research could result in information that can 
be used to provide empirically based recom¬ 
mendations to schools regarding ways they 
can improve the sustainability of SWPBIS and, 
potentially, other school-based interventions. 
The purpose of this study was to replicate and 
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extend the results of McIntosh and colleagues 
(2014) with a larger, more diverse sample. The 
following research questions were addressed: 
(1) What are perceived as the most important 
enablers for sustaining SWPBIS? (2) What are 
perceived as the most significant barriers to 
sustaining SWPBIS? 

Method 

Participants and Settings 

Participants were 860 educators with 
knowledge of the SWPBIS systems in their 
particular schools. The majority (61%) of 
participants identified themselves as a school 
PBIS team leader/facilitator/internal coach, 
followed by school administrator (24%), 
school PBIS team member (9%), and district/ 
external coach (5%). The 860 schools were 
from 14 U.S. states and all four U.S. census 
regions. School demographic data from the 
National Center for Education Statistics were 
available for 99% (n = 850) of the schools. 
The majority of schools were elementary 
schools (68%); 20% were middle schools and 
12% were high schools. In terms of urbanicity, 
33% were suburban, 28% were urban, 25% 
were rural, and 14% were located in towns. 
The mean percentage of students receiving free 
or reduced priced meals was 50%. Regarding 
the length of SWPBIS implementation, 25% of 
schools were in Year 0 or 1 of implementation, 
48% of schools had been implementing 
between 2 and 4 years, and 28% had been 
implementing for 5 or more years. 

Measure 

Participants completed the SUBSIST (Mc¬ 
Intosh et al., 2009), a research-validated 
measure assessing the presence of variables 
related to implementation and sustainability of 
universal behavior support interventions (Mc¬ 
Intosh et al., 2011). The SUBSIST also includes 
two open-ended questions: (1) "What is the 
most important factor for sustaining SWPBIS?" 
and (2) "What is the most significant barrier to 
sustaining SWPBIS?" These two questions 
were the focus of the present analyses. 

Procedure 

Participants completed the SUBSIST dur¬ 
ing the first year of a longitudinal study of 
implementation and sustainability of school- 
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based interventions. The authors recruited 
participants through state SWPBIS coordina¬ 
tors in states with strong state networks (e.g., 
ongoing communication with participating 
schools, regular submission of implementation 
data to the National Center on PBIS). State 
coordinators were asked to announce the 
study at training and coaching events and to 
forward an invitation to participate to school 
and district personnel that might be interested 
in participating. Schools just beginning im¬ 
plementation of SWPBIS and schools at in¬ 
creased risk for abandonment were specifically 
recruited for participation through announce¬ 
ments at initial team trainings and coach 
trainings, respectively. Participation occurred 
through completing the survey online through 
a provided web link. If multiple personnel 
from the same school responded, the partici¬ 
pant with the most complete responses to the 
survey (i.e., the survey with the fewest 
unanswered questions) was included for that 
school. 

Design and Analyses 

A qualitative, phenomenological ap¬ 
proach allowed respondents to share briefly 
their lived experiences regarding systems 
change and sustainability as it related to 
SWPBIS. The open-ended questions allowed 
for responses that were not constrained by 
items on the measure derived from previous 
research (Baron, 2008). Through an open 
coding process (Patton, 2002), responses were 
coded into themes representing facilitators or 
barriers to sustainability. In this inductive 
process, the authors reviewed participant 
responses and looked for patterns in the data. 
Once patterns were identified, the first author 
drafted definitions of potential themes and 
continually revised these definitions while 
sorting through the data. This iterative process 
continued until all participant responses were 
coded with one theme. Of the 93% of 
respondents who answered at least one of the 
two open-ended questions (92% answered 
both), 1,256 facilitator units and 1,029 barrier 
units were identified and coded into 13 
themes. Themes were included in the findings 
if they were represented by at least 3% of units 
(Patton, 2002). The fourth author then in¬ 
dependently coded a randomly selected 20% 
of responses to ensure reliability of coding. The 
point-by-point intercoder agreement was 83% 
for number of units per response. Intercoder 
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agreement for coding of themes was 82%, 
which was later raised through a consensus 
meeting to an agreement of 98%. 

Findings 

The analysis yielded 13 themes from 
responses to the two open-ended questions. 
These themes and their corresponding defini¬ 
tions are presented in Table 7. The number of 
coded responses by theme for the question, 
"What is the most important factor for 
sustaining SWPBIS?" is presented in Figure 7. 
The number of coded responses by theme for 
the question, "What is the most significant 
barrier to sustaining SWPBIS?" is presented in 
Figure 2. Findings and the most common 
themes are described by question in the 
following sections. 

Enablers 

Staff buy-in. The most frequent theme 
representing factors important to the sustain¬ 
ability of SWPBIS was staff buy-in (n = 214). 
Staff buy-in describes the commitment of 
teachers and staff in supporting PBIS imple¬ 
mentation. Because this theme does not in¬ 
clude buy-in from school administrators or 
other stakeholders (i.e., families, the commu¬ 
nity), this theme represents the notion of 
grassroots support for the approach. For 
example, one respondent replied, "I think that 
the most important factor for sustaining PBIS is 
to have teacher and staff buy-in for the 
initiative." Another responded, "Teacher 
buy-in has kept the program running well." A 
lack of buy-in was also the most commonly 
identified barrier to SWPBIS, indicating the 
critical function of broad-based support to the 
sustainability of SWPBIS. 

School administrator support. The second 
most frequent theme, school administrator 
support (n = 197), represents active support 
of building-level administration, such as prin¬ 
cipals or vice principals. This theme specifi¬ 
cally describes support from school (not 
district) administrators. Respondents descri¬ 
bed how important principal support was as 
a facilitator of sustainability. For example, one 
respondent wrote, "Administrative support is 
the most crucial part if PBIS will be effective. 
Without it, no matter how hard the team will 
try to change things, it will not work." Another 
responded, "All schools need an administrator 
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TABLE 1 

Themes Generated from Open-Ended Responses and Corresponding Definitions 


Theme 


Definition 


Staff buy-in (n = 377) Staff buy-in or continued commitment to PBIS, including staff enthusiasm and encouragement. 

School administrator Support from building-level administration or a leader in the building (could be a PBIS team 

support (n = 239) member). General references to support or leadership or someone to "keep everything going." 


Resources: time (n = 198) Time needed to complete activities related to PBIS. 

Consistency (n = 184) Consistency among staff or the school team regarding PBIS implementation, common language, 

or working toward a common goal. Consistency of implementation across time. 

Training (n = 173) Staff training, professional development, coaching, or continuing education regarding PBIS. 


Resources: money (n = 153) Money needed to complete activities related to PBIS. 


Teaming (n = 126) 


PBIS philosophy (n = 124) 


Effectiveness (n = 100) 


Effectiveness of teaming, team leadership, meetings, activities during meetings, or frequency and 
consistency with which meetings occur. Representativeness of team members. 

Agreement with behavior analytic principles of PBIS, including using a positive/nonpunitive 
approach, creating a safe and positive school climate or culture, placing a focus on 
prevention, and teaching skills explicitly to students. 

Seeing results or the effectiveness of PBIS (e.g., effects on teacher-student relationships, school 
climate, problem behavior, academic performance). Staff recognition or celebrations to 
acknowledge success. 


Fidelity of implementation Implementing critical features of PBIS with fidelity. Activities needed to sustain PBIS effectively. 
(n = 99) 


Data (n = 90) 


Collection, analysis, or use of implementation or outcomes data, including sharing data within 
and outside the school. 


Student buy-in (n = 73) Student involvement and buy-in to PBIS practices. Student interest in incentives. 


Integrating other 
initiatives (n = 65) 


Extent to which PBIS is integrated with other initiatives (e.g., response to intervention, other 
evidence-based practices). Presence of competing initiatives that leave staff feeling 
overwhelmed. 


Note, n = the number of codes generated from all open-ended questions. The full codebook is available from the first author. 


who eats and breathes PBIS in order for all staff 
to feel connected to it." Similarly, "You need 
a strong principal to present it and believe in it 
and then show the staff why it is so important 
and beneficial to the students, teachers and 
community. Without a strong leader and staff 
buy-in the program will fall apart." 

Consistency. Consistency (n = 118) refers 
to a common approach among staff, school 
personnel, or school teams. The theme 
describes consistency pertaining to plan im¬ 
plementation, common language, or working 
toward a common goal. Respondents ap¬ 
peared to value consistency and identify it as 
needed for sustainability. One respondent 
wrote, "The teachers love the consistency of 
message across all grade levels." Another 
responded, "The focus and vocabulary of PBIS 
is used consistently by all staff and with all 
students." Another indicated, "consistency 
across all grade levels that is given by teachers, 
administrators, and support staff. The same 
message and strategies need to be consistently 
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demonstrated in order to promote growth and 
sustainability." 

Additional enablers. There were eight 
remaining themes representing enablers for 
sustaining SWPBIS. These themes were train¬ 
ing (n = 11 6), teaming (n = 96), effectiveness 
(n = 83), PBIS philosophy (n = 81), data 
(n = 61), fidelity of implementation (n = 48), 
resources: time (n = 38), and resources: 
money (n = 38). 

Barriers 

Staff buy-in. As with enablers, the most 
frequent barrier theme was staff buy-in (n = 
1 63). When describing staff buy-in as a barrier 
to sustainability, one respondent indicated, 
"The biggest barrier for our school has been 
getting staff to buy in initially. I think once they 
have gotten on board, they are willing. It is the 
initial step." Another responded, "It is difficult 
to get staff to buy in. Getting the common 
language of PBIS is difficult for staff. It is 
difficult to change viewpoints towards pro- 
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Figure 1. Number of coded responses by theme for the question: "What is the most important 
factor for sustaining SWPBIS?" Note. Only themes represented by at least 3% of units 
are included. 


active and preventative approaches rather than 
punitive, as what most teachers in our school 
are used to doing." Another indicated, 

Teacher buy-in has been a challenge. Being 
a turn-around school has placed a lot of 
pressures on our teachers. A lot of teachers 
feel like PBIS is 'just another thing' they have 
to do that won't have a significant enough 
positive outcome to be worth their time. 
We're trying to combat that at our weekly 
PD [professional development] sessions. 

Resources: time. The second most fre¬ 
quent barrier theme was resources: time (n = 
160). Time refers to the resources needed to 
carry out activities related to SWPBIS in terms 
of individuals' time for planning or imple¬ 
mentation. Respondents described the signif¬ 
icant time commitment needed to conduct 
multiple activities related to SWPBIS (e.g., 
planning, meeting, data review, completing 
fidelity measures). To illustrate, one respon¬ 
dent commented, "Time! More time is 
needed to be able to meet as a team, share 
data with staff, do problem-solving, train 


new staff, train para-educators, conduct fide¬ 
lity and other implementation measures." 
Another replied, 

Time for preparation ... all student time is 
teaching/instructional time; therefore, teachers 
have very limited planning/prep time. As far as 
time for prep with SWPBIS . . . preparation of 
lesson . . . preparation of materials/photos for 
display in hallways .. . having enough time .. . 
seems to be the most significant barrier. 

Resources: money. Resources: money (n = 
115) describes monetary resources needed to 
implement SWPBIS. Many responses for this 
theme were simply one-word responses, such 
as "funding" or "money." Others were more 
detailed, such as 

Funding for the school-wide initiative is 
difficult to come across. The state gives us 
less than $200 a year to help us implement 
the school-wide program. Our school admin¬ 
istration funds the rest of the rewards, 
incentives, and materials necessary to keep 
our program operational. 
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Figure 2. Number of coded responses by theme for the question: "What is the most significant 
barrier to sustaining SWPBIS?" Note. Only themes represented by at least 3% of units 
are included. 


Another respondent wrote, "currently, we do 
not have a budget for PBIS." Similarly, 

the cost of implementing PBIS is a definite 
barrier. PBIS does not have a required budget. 
While our team has made every effort to keep 
costs to a bare minimum, it is impossible to 
run this program on no cost at all. 

Additional barriers. There are seven addi¬ 
tional themes that represented barriers to sustain¬ 
ing SWPBIS. These themes are consistency (n = 
66), integrating other initiatives (n = 57), training 
(n = 57), fidelity of implementation (n = 51), 
student buy-in (n = 50), PBIS philosophy (n = 43), 
and school administrator support (n = 42). 

Discussion 

The purpose of this study was to identify 
what school and district personnel perceive as 
the most significant enablers and barriers to the 
sustainability of SWPBIS. To this end, educators 
from 860 schools completed SUBSIST (McIntosh 
et al., 2009). Through an open coding process 
(Patton, 2002), participant responses to ques¬ 
tions regarding facilitators and barriers to sus¬ 
tainability were coded into 13 themes. Results 


from the analysis indicated that the most 
frequently identified enablers for the sustainabil¬ 
ity of PBIS were staff buy-in (n = 214), school 
administratorsupport(n = 197), and consistency 
(n = 11 8). The most frequently identified barriers 
to sustaining SWPBIS were staff buy-in (n — 
163), resources: time (n = 160), and resources: 
money (n — 11 5). Comparing these findings with 
those of McIntosh et al. (2014) illuminates 
differences that could be due to the current 
sample being at a relatively earlier stage in the 
SWPBIS implementation process. Although the 
nature of these qualitative studies preclude 
group comparisons, the difference in years 
implementing SWPBIS between the samples 
(e.g., 25% of the sample in Year 0 or 1, 
compared with 9% of the previous sample) 
may highlight differences in the relative impor¬ 
tance of themes that contribute to sustainability, 
based on stage of SWPBIS implementation. 

Importance of Staff Buy-in 

The present study is consistent with pre¬ 
vious research indicating the importance of 
staff buy-in to the implementation and sustain¬ 
ability of evidence-based practices in schools 
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(Forman et al., 2009; Langley et al., 2010). In 
the present study, staff buy-in was the most 
frequently identified enabler as well as the most 
frequently identified barrier to the sustainability 
of SWPBIS. Stated differently, participants in¬ 
dicated that staff buy-in was one of the most 
important factors contributing to SWPBIS 
sustainability, and when staff buy-in was 
lacking, its absence was a significant barrier. 

These results differ from those of McIntosh 
et al. (2014), where staff buy-in was the second 
most frequently identified enabler and the 
fourth most frequently identified barrier. Be¬ 
cause the majority (73%) of schools in the 
current study had been implementing SWPBIS 
for 4 years or fewer, compared with McIntosh et 
al. (2014) where this group was smaller (45%), 
it is possible that schools that have not been 
implementing SWPBIS long are more preoccu¬ 
pied with gaining staff support. It has been 
suggested that school personnel may need to 
experience the positive outcomes of the prac¬ 
tice to become more supportive (Andreou et al., 
in press). In other words, school staff are more 
likely to support a practice (e.g., SWPBIS) once 
they have experienced naturally occurring re¬ 
inforcement for its use (e.g., decrease in student 
problem behavior and increase in appropriate 
behavior). In the present study, many schools 
had not yet begun implementation. Therefore, 
staff support might be minimal and perceived as 
a factor that would aid in sustained implemen¬ 
tation (an enabler) because it is currently 
impeding implementation (a barrier). Staff 
experience level is another possible explana¬ 
tion for why staff buy-in was identified as an 
enabler and barrier for schools in the early 
stages of implementation. Baker et al. (2004) 
noted the profound differences in opinions in 
implementation among staff members who 
were new and those who were more experi¬ 
enced with the intervention. More experienced 
staff relayed more positive perspectives, and 
those who were new were more exposed to 
logistical training concerned with basic opera¬ 
tions of the intervention, which resulted in 
negative opinions of the intervention. 

Importance of School Administrator 
Support 

In the present study, school administrator 
support was the second most frequently 
identified enabler, which aligns with previous 
research emphasizing the importance of ad¬ 
ministrator support in the implementation and 
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sustainability of interventions in education 
(Andreou et al., in press; Forman et al., 2009; 
Kincaid et al., 2007; Langley et al., 2010). This 
theme was the most cited theme in the 
previous study (McIntosh et al., 2014), 
indicating its importance throughout imple¬ 
mentation, from initial implementation to sust¬ 
ainability. Even among schools with strong 
SWPBIS systems and adequate district and 
state support, the lack of school administrator 
support is a strong predictor of abandonment 
(Nese et al., 2015). 

Resources 

In previous research, a lack of resources 
has been identified as a significant barrier to 
implementation (see Forman et al., 2009; 
Kincaid et al., 2007; Massatti et al., 2008; 
McIntosh et al., 2014; Sanford DeRousie & 
Bierman, 2012; Seffrin et al., 2009; Tyre et al., 
2010). Similar findings were observed in the 
present study, where resources, more specifi¬ 
cally resources: time and resources: money, 
were among the most frequently identified 
barriers (second and third, respectively). The 
present study differs from previous research in 
that a general resources theme was divided to 
specify resource type (money or time). Al¬ 
though both themes were reported at similar 
frequencies, more respondents noted the 
importance of time. These findings may be 
particular to SWPBIS, given that materials for 
implementation are generally freely available 
online, and thus money is less of a barrier than 
for a program that requires purchasing manuals 
or implementation materials. Nevertheless, 
many individuals noted the lack of money for 
implementation. Previous research indicates 
that newer implementers more often focus on 
logistical barriers (e.g., lack of actual cash from 
the district), whereas more experienced imple¬ 
menters focus on advanced barriers that refer 
to procedural and conceptual details of im¬ 
plementation (e.g., finding time to schedule 
meetings or teaching; Baker et al., 2004). As 
such, the identification of money as a barrier in 
the present study may be the resu It of the sample 
including newer implementers, rather than a lack 
of money actually impeding sustainability. How¬ 
ever, because money was identified as one of 
the top barriers, it warrants recognition as 
a potential problem impeding the sustained 
implementation of SWPBIS. Because SWPBIS 
can often be implemented with little to no 
additional money after training (e.g., use of 
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free materials, focus on free reinforcers; 
Blonigen et al., 2008), money may be less of 
a barrier to creative staff, and this aspect of 
SWPBIS may make it more sustainable. 

Limitations 

Although results of this study provide 
valuable information regarding factors that 
may affect SWPBIS sustainability, some limita¬ 
tions are recognized. First, responses obtained 
from the sample in the present study may not 
be generalizable to the larger population of 
school personnel who are implementing 
SWPBIS, and the lack of data regarding 
response rate makes it difficult to assess bias 
in responding. In the present study, 860 school 
personnel responded to questions regarding 
enablers and barriers to SWPBIS sustainability. 
This sample is relatively small when compared 
with the large number of schools implement¬ 
ing SWPBIS across the globe. In addition, 
respondents from schools preparing to imple¬ 
ment SWPBIS may have reported perceived 
future enablers and barriers that might vary 
after they implement with students. Moreover, 
the present findings are also limited to the 
sustainability of SWPBIS in particular. Al¬ 
though these findings are consistent with 
previous studies examining the implementa¬ 
tion of other school-based interventions (Lang¬ 
ley et al., 2010), the generalizability of the 
study findings to understanding sustainability 
as a phenomenon itself is limited. Finally, the 
qualitative nature of this study presents some 
limitations in that participant responses are 
prone to bias (e.g., imperfect recall, idiosyn¬ 
cratic perceptions). Results of this study should 
guide future experimental research to deter¬ 
mine whether the factors identified by the 
participants are indeed enablers and barriers to 
SWPBIS sustainability. 

Implications for Practice 

The available research suggests that im¬ 
proving staff buy-in and support may improve 
the sustainability of SWPBIS, and specific 
activities to improve staff buy-in have been 
proposed in the literature (Feuerborn, Wallace, 
& Tyre, 2013). When addressing staff buy-in, it 
may be helpful to differentiate between 
strategies that may be more useful prior to 
implementation versus during implementation. 
Prior to implementation, when schools are 
determining whether to adopt the new practice 

180/May 2015 


(e.g., SWPBIS), it may be beneficial to include 
staff meaningfully in discussions regarding 
whether to select the practice. Previous re¬ 
search has suggested that assessing staff con¬ 
cerns before implementation and tailoring the 
practice to their needs may enhance buy-in 
during the fragile initial implementation period 
(Hall & Hord, 2006). The Self-Assessment and 
Program Review for Programs for Positive 
Behavior Interventions and Supports (Walker 
& Cheney, 2012) is one tool that can be used 
to assess staff apprehensions about PBIS and 
implement and develop a more tailored 
implementation approach. 

When initially implementing SWPBIS, 
activities to improve staff buy-in may be of 
particular importance for staff who are new to 
SWPBIS and who are expending effort in 
building the infrastructure for SWPBIS imple¬ 
mentation but are not yet seeing results. For 
these staff, logic suggests that their implemen¬ 
tation behavior will not sustain unless they 
experience reinforcement (i.e., improved stu¬ 
dent behavior) to maintain that behavior. In 
addition, new staff may be less likely to 
verbally indicate their support and commit¬ 
ment for a practice, given that they have not 
yet observed positive effects as a result of its 
implementation. Furthermore, previous re¬ 
search has suggested that new teachers in 
particular may be less likely to implement 
additional practices, due to the standard 
responsibilities and duties to which they are 
becoming accustomed as new teachers (Baker 
et al., 2004). To improve the eventual buy-in 
and support of new staff, the school or district 
team might use reinforcement systems for staff 
implementation behavior during the early 
stages of implementation, such as public 
acknowledgement or drawings (e.g., coverage 
of class or supervision duties, coffee cards). 
These reinforcement systems could aid in 
reinforcing and maintaining staff implementa¬ 
tion behavior until naturally occurring re¬ 
inforcers (i.e., improved student outcomes) 
are present. Efforts could also be put forth tow¬ 
ard identifying ways to improve the saliency of 
early outcomes for SWPBIS implementation 
(e.g., graphs showing level of implementation 
and student outcomes by month). This way, 
the consequences (i.e., reinforcers) for imple¬ 
mentation become more clear to staff, and 
their implementation behavior will likely 
maintain until more pronounced and readily 
observable reinforcers are present. In addition, 
it would be prudent to conduct follow-up 
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coaching and support to ensure staff are 
implementing SWPBIS with high treatment 
fidelity. If staff are not implementing SWPBIS 
with fidelity, it is unlikely they will experience 
reinforcing consequences (e.g., student suc¬ 
cess) as a result of SWPBIS implementation. 

Finally, improving administrator support 
appears to be a worthwhile focus to improving 
the sustainability of SWPBIS. Some recent 
articles provide guidance on cultivating sup¬ 
port from school administrators (McIntosh, 
Kelm, & Canizal Delabra, 2015; Strickland- 
Cohen, McIntosh, & Horner, 2014). School 
administrator support is related partly to in¬ 
dividual administrators and the degree to 
which they support SWPBIS but also to district 
support because support from the district level 
can affect school administrator support in¬ 
directly. By institutionalizing the practice into 
hiring processes (e.g., placing SWPBIS into job 
descriptions and hiring preferences for school 
principals) and providing training to new 
school administrators, district teams can dra¬ 
matically enhance building-level administrator 
support (Fixsen, Naoom, Blase, Friedman, & 
Wallace, 2005). 

Future Research 

Results of this study provide valuable 
information that can guide future research on 
SWPBIS sustainability. Perhaps most impor¬ 
tant, the factors identified as enablers of and 
barriers to sustainability in the current study 
should be experimentally evaluated to de¬ 
termine if they do indeed affect the sustain¬ 
ability of SWPBIS. For example, in the present 
study, staff buy-in was the most frequently 
identified enabler when present as well as one 
of the most significant barriers when absent. 
Future research could examine the effects of 
varying activities to improve staff buy-in and 
examine whether improvement contributes to 
the sustained implementation of SWPBIS. 
Similar lines of research could examine the 
effects of other enablers and barriers on 
SWPBIS sustainability. These factors include 
school administrator support, consistency of 
implementation, staff training, and resource 
allocation as it relates to funding and time. 

Although not one of the most frequently 
identified enablers or barriers, training was the 
fifth most frequently cited theme in terms of 
total responses (see Table 1). As such, staff 
training might be an important variable to 
consider for the sustained implementation of 
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SWPBIS. Research indicates that effective staff 
training includes didactic instruction regarding 
the theoretical foundations of the practice, 
modeling, practice, performance feedback, 
coaching, and follow-up support (Fixsen 
et al., 2005; Joyce & Showers, 2002). Although 
the research is clear that these components of 
staff training are important, the specific activ¬ 
ities involved in each of the components and 
how they affect sustainability have yet to 
be defined. With an improved understanding 
of sustainability, schools can be better in¬ 
formed on how to increase the sustained use 
of effective practices resulting in improved 
outcomes for students who are at an increased 
risk for poor academic and social outcomes, 
such as those identified with EBD. 
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